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TITLE OF THE INVENTION 

IMAGE FORMING APPARATUS AND METHOD FOR OPERATING IMAGE 
FORMING APPARATUS BY USING REMOTE APPLICATION 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to techniques for operating an image forming apparatus 
by using a JAVA application. 

2. Description of the Related Art 

Recently, an image forming apparatus (to be referred to as a compound machine 
hereinafter) that includes functions of a printer, a copier, a facsimile, a scanner and the like in 
a cabinet is generally known. The compound machine includes a display part, a printing part 
and an image pickup part and the like in a cabinet. In the compound machine, pieces of 
software corresponding to the printer, copier and facsimile respectively are provided, so that 
the compound machine functions as the printer, the copier, the scanner and the facsimile 
respectively by switching the pieces of software. 

Since the conventional compound machine is provided with respective pieces of 
application software for the printer, the copier, the scanner and the facsimile, much time is 
required for developing each application. To solve this problem, the applicant has developed 
a compound machine including hardware resources, a plurality of applications, and a 
platform including various control services provided between the applications and the 
hardware resources. The hardware resources are used for image forming processes for a 
display part, a printing part and an image pickup part. The applications perform processes 
intrinsic for user services of printer, copier and facsimile and the like. The platform includes 
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various control services for performing management of hardware resources necessary for at 
least two applications commonly, and for performing execution control of the applications 
and image forming processes, when a user service is executed. 

According to such a new compound machine, the applications and the control services 
5 are provided separately. Thus, after the compound machine is shipped, users or third party 
venders can develop new applications to install on the compound machine without changing 
the system side software. 

Various applications are developed. For developing the applications, from a 
viewpoint of supporting various platforms and network communications, it is considered to 

1 0 use JAVA applications as applications for the compound machine. As a conventional 

technology relating to the JAVA application, a technology described in Japanese laid open 
patent application No.2002-287990 is known, for example. 

For executing the JAVA applications on the compound machine, a module is 
necessary for managing the JAVA applications. In addition, for developing the JAVA 

1 5 application for the compound machine, it is necessary to evaluate the developed application 
whether the application actually operates on the compound machine after the JAVA 
application is developed on a PC and the like. However, it is troublesome to install and 
execute the JAVA application on the compound machine every time when the evaluation is 
performed. Thus, an environment is required in which the developed application can be 

20 directly executed on the compound machine from the PC on which the application is 

developed. In addition, if remotely executed JAVA application can operate the compound 
machine, user convenience increases for using the JAVA application. 



SUMMARY OF THE INVENTION 
25 An object of the present invention is to provide an environment in which the JAVA 

application can be easily executed in the compound machine and to provide an environment 
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in which the compound machine can be operated by a JAVA application that is executed on a 
terminal apparatus such as the PC. 

The above object is achieved by an image forming apparatus that includes a control 
part that provides common services on control of hardware resources to a plurality of 
5 applications so as to be able to include a plurality of applications, the image forming 
apparatus including: 

a virtual machine; 

an application that is executed by the virtual machine; and 

an application management part managing the application that is executed by the 
1 0 virtual machine. 

According to the present invention, since the virtual machine is provided on the 
application layer of the image forming apparatus, the JAVA application that can be executed 
by the virtual machine can be executed. In addition, since the application management part is 
provided, it is easy to add, delete, and manage JAVA applications. Thus, the JAVA 
1 5 application can be easily executed on the image forming apparatus. 

In the image forming apparatus, the application that is executed by the virtual 
machine can operate the image forming apparatus by using classes for controlling the image 
forming apparatus. The classes include an operation panel class for outputting information to 
an operation panel of the image forming apparatus and for inputting information from the 
20 operation panel. By using the classes, the JAVA application can be easily developed. 

In the image forming apparatus, the application management part includes execution 
management functions that include a function for launching the application executed by the 
virtual machine. In addition, the application management part downloads the application 
when the application is not installed in the image forming apparatus. 
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The application management part refers to an application information file associated 
with the application, and updates the application on the basis of information in the application 
information file. Since the application can be updated on the basis of the setting of the 
application information file, the application can be automatically updated. 
5 The application management part can compare a first version described in the 

application information file associated with the application with a second version described in 
another application information file associated with an update application, and the application 
management part replaces the application with the update application if the second version is 
newer than the first version. Thus, an old application can be automatically updated. 

10 The application management part may download the application from a memory card 

or from a Web site. In addition, the application management part may download the 
application from a location described in the application information file associated with the 
application. The application management part can check whether the application is 
executable in the image forming apparatus before downloading the application, and the 

1 5 application management part can check whether the application is executable on the basis of 
information described in the application information file associated with the application. In 
addition, the application management part can check items including a resource item in the 
image forming apparatus necessary for executing the application. Therefore, the application 
can be safely installed and updated. 

20 The image forming apparatus may include a server application that receives an 

operation request from a terminal apparatus connected to the image forming apparatus and 
that operates the image forming apparatus according to the operation request. According to 
the present invention, the image forming apparatus can be operated by the application 
executed in the terminal apparatus. The application management part communicates with the 

25 terminal apparatus. 
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In addition, the above-mentioned object is achieved by a terminal apparatus that 
operates an image forming apparatus configured to be able to include a plurality of 
applications, the terminal apparatus including: 

a virtual machine; 

5 an application that is executed by the virtual machine and that operates the image 

forming apparatus; and 

an application management part managing the application that is executed by the 
virtual machine. 

According to the present invention, the image forming apparatus can be operated by 
10 the application executed in the terminal apparatus. 

The terminal apparatus is connected to the image forming apparatus via a network, 
and the application that is executed by the virtual machine operates the image forming 
apparatus by using classes for controlling the image forming apparatus. In addition, the 
terminal apparatus can operate the image forming apparatus by using a JAVA based 
1 5 distributed object processing technique. By using the JAVA based distributed object 

processing technique that supports processing via a network, the image forming apparatus 
can be operated by an application executed in an apparatus on a network. 

In the terminal apparatus, the classes may include a function for displaying, on the 
terminal apparatus, an emulated screen of a screen displayed on an operation panel of the 
20 image forming apparatus. Thus, the user can operate the image forming apparatus from the 
terminal apparatus as if to operate the image forming apparatus directly. 

The terminal apparatus may have a function for allowing a user to select whether to 
access a hard disk of the image forming apparatus or to access a hard disk of the terminal 
apparatus. For example, the user can select a file stored in the hard disk of the image forming 
25 apparatus from the terminal apparatus. 
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In the terminal apparatus, the application management part may include execution 
management functions that include a function for launching the application, and may 
download the application when the application is not installed in the terminal apparatus by 
communicating with the image forming apparatus. In addition, the application management 
5 part can refer to an application information file associated with the application, and update 
the application on the basis of information in the application information file. 

The application management part can download the application from a memory card 
that is inserted in the image forming apparatus or from a Web site. In addition, the 
application management part can receive file information stored in the memory card and 
10 displays the file information on the terminal apparatus. 

The application management part can send URL information input into the terminal 
apparatus to the image forming apparatus, so that the image forming apparatus downloads the 
application from the Web site by using the URL information. Since the application 
management part communicates with the image forming apparatus for performing processes, 
1 5 the management function for applications in the image forming apparatus can be extended to 
the terminal apparatus. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Other objects, features and advantages of the present invention will become more 

20 apparent from the following detailed description when read in conjunction with the 

accompanying drawings, in which: 

Fig.l is a block diagram of a compound machine 100 according to an embodiment of 

the present invention; 

Fig.2 shows an example of a hardware configuration of the compound machine 100; 

25 Fig.3 shows a configuration example of a JAVA execution environment 116 

according to a first embodiment; 
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Figs.4A and 4B show implementation examples of an application management part 

204; 

Fig. 5 shows an example of a hierarchy structure of the operation panel used by the 
JAVA application; 
5 Fig. 6 shows a program list of the JAVA application; 

Fig.7 is a screen displayed by the simple printer; 

Fig. 8 is an example of a soft keyboard displayed by executing the simple printer; 
Fig.9 is a flowchart showing a procedure for launching the simple printer according to 
the first embodiment; 
1 0 Fig. 1 0 shows an example of a syntax of a JNLP file; 

Fig. 1 1 shows a tree structure of the JNLP file; 

Fig. 12 is a flowchart for automatically updating a JAVA application (update target 
application) in an SD card (which is an example of a memory card) or in a HDD with a 
JAVA application (update application) from a SD card; 
1 5 Fig. 1 3 is a flowchart for automatically updating a JAVA application (update target 

application) in the SD card or in the HDD with a JAVA application (update application) from 
a Web server; 

Fig. 14 shows a system configuration according to a third embodiment of the present 
invention; 

20 Fig. 15 is a flowchart showing a procedure for launching the simple printer according 

to the third embodiment; 

Fig. 16 is a block diagram of the compound machine according to a fourth 
embodiment of the present invention; 

Fig. 17 shows classes of the JSDK application 147 and the JSDK platform 148 in 

25 Fig. 16; 
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Fig. 1 8 shows a system configuration according to the fourth embodiment; 

Fig. 19 shows classes of the JSDK application 147 and the JSDK platform 148 in the 

PC 701 in Fig. 18; 

Fig.20 is a figure for explaining execution procedure of preparation processes for 
5 remote operation in the compound machine 100. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
In the following, embodiments of the present invention are described with reference 

to figures. In the following, a JAVA execution environment in the compound machine is 

10 described as first and second embodiments. Next, an environment in which the compound 
machine is operated by executing an application, developed in a PC and the like, in the PC is 
described as third and fourth embodiments. First, the compound machine used in the first to 
third embodiments is described. 

Fig.l is a block diagram of a compound machine 100 according to an embodiment of 

1 5 the present invention. 

As shown in Fig. 1 , the compound machine 1 00 includes hardware resources 1 03 and 
a software group 110. The hardware resources 103 include a black and white laser printer 
(B&W LP) 101, a color laser printer 102, and hardware resources such as a scanner, a 
facsimile, a hard disk, memory (RAM, NV-RAM, ROM and the like) and a network 

20 interface. The software group 110 includes a platform 120, and applications 130. 

The platform 120 includes control services for interpreting a process request from an 
application to issue an acquiring request for the hardware resources, a system resource 
manager (SRM) 123 for managing one or more hardware resources and arbitrating the 
acquiring requests from the control services, and a general -purpose OS 121. 

25 The control services include a plurality of service modules, which are a system 

control service (SCS) 122, an engine control service (ECS) 124, a memory control service 
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(MCS) 125, an operation panel control service (OCS) 126, a fax control service (FCS) 127, 

and a network control service (NCS) 128. The platform 120 has application program 

interfaces (API) that can receive process requests from the applications 130 by using 

predetermined functions. 
5 The general purpose OS 121 is a general purpose operating system such as UNIX, and 

can execute each piece of software of the platform 120 and the applications 130 concurrently 

as respective processes. 

The process of the SRM 123 is for performing control of the system and performing 

management of resources with the SCS 122. The process of the SRM 123 performs 
10 arbitration and execution control for requests from the upper layer that uses hardware 

resources including engines such as the scanner part and the printer part, a memory, a HDD 

file, and a host I/Os (Centronics I/F, network I/F IEEE 1394 I/F, RS232C I/F and the like). 
The process of the SCS 122 performs application management, control of the 

operation panel, display of system screen, LED display, resource management, and interrupt 
15 application control. The process of the ECS 124 controls engines of hardware resources 

including the white and black laser printer (B&W LP) 101, the color laser printer (Color LP) 

102, the scanner, and the facsimile and the like. 

The process of the MCS 125 obtains and releases an area of the image memory, uses 

the hard disk apparatus (HDD), and compresses and expands image data. The process of the 
20 FCS 127 provides APIs for sending and receiving facsimile by using PSTN/ISDN network 

from each application layer, registering/referring of various kinds of facsimile data managed 

by BKM (backup SRAM), facsimile reading, facsimile receiving and printing, and mixed 

sending and receiving. 

The NCS 128 is a process for providing services commonly used for applications that 
25 need network I/O. The NCS 128 distributes data received from the network to a 
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corresponding application, and acts as mediation between the application and the network 
when sending data to the network. More specifically, the process of the NCS 128 includes 
server daemon such as ftpd, httpd, lpd, snmpd, telnetd, smtpd, and client function of the 
protocols. 

5 The process of the OCS 126 controls an operation panel that is a means for 

transferring information between the operator (user) and control parts of the machine. In the 
compound machine 100 of the embodiment, the OCS 126 includes an OCS process part and 
an OCS function library part. The OCS process part obtains an key event, which indicates 
that the key is pushed, from the operation panel, and sends a key event function 

10 corresponding to the key event to the SCS 122. The OCS function library registers drawing 
functions and other functions for controlling the operation panel, in which the drawing 
functions are used for outputting various images on the operation panel on the basis of a 
request from an application that has control right or from a control service. When the 
application is developed, functions in the OCS function library is linked to an object program 

1 5 that is generated by compiling a source code file of the application, so that an executable file 
of the application is generated. 

The applications 130 include a printer application 1 1 1 that is an application for a 
printer having page description language (PDL) and PCL and post script (PS), a copy 
application 1 12, a fax application 113 that is an application for facsimile, a scanner 

20 application 114 that is an application for a scanner, and a network file application 115. In 

addition, a JAVA execution environment 116 and a JAVA application 1 17 are included. The 
compound machine 100 shown in Fig.l includes a plurality of JAVA applications. 

Interprocess communication is performed between a process of the application and a 
process of the control service, in which a function is called, a returned value is sent, and a 

25 message is sent and received. By using the interprocess communication, user services for 
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image forming processes such as copying, printing, scanning, and sending facsimile are 
realized. 

As mentioned above, the compound machine 100 of this embodiment includes a 
plurality of applications 130 and a plurality of control services, and each of those operates as 
5 processes. In each process, one or more threads are generated and the threads are executed in 
parallel. The control services provide common services to the applications 130. User 
services on image formation such as copying, printing, scanning and sending facsimile are 
provided while the processes are executed in parallel, the threads are executed in parallel, and 
interprocess communication is performed. A third party vendor can develop new 
10 applications for the compound machine 100, and can execute the applications in the 
application layer on the control service layer in the compound machine 100. 

Fig.2 shows an example of a hardware configuration of the compound machine 100. 

As shown in Fig.2, the compound machine 100 includes a controller 40, an operation 
panel 60, a fax control unit (FCU) 65, and an engine 70 and a plotter 75. 
1 5 The controller 40 includes a CPU 41 , a MEM-P (system memory) 42, a north bridge 

(NB) 43, a south bridge (SB) 44, an ASIC 45, a MEM-C (local memory) 46, an HDD 47, a 
network interface card (NIC) 48, a USB device 49, an IEEE1394 device 50, and a Centronics 
51. 

The operation panel 60 is connected to the ASIC 45 of the controller 40 directly. The 
20 FCU 65, interfaces, the engine 70 and the plotter 75 are connected to the ASIC 45 in the 
controller 40 via a PCI bus. 

The CPU 41 controls the compound machine 100. The NB 43 is a bridge for 
connecting the CPU 41, the MEM-P 42 and the ASIC 45. The MEM-P 42 is a system 
memory used as a drawing memory for example. The SB 44 is a bridge for connecting the 
25 NB 43 and peripheral devices. In this embodiment, a memory card slot 441 is provided in 
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which a memory card 442 can be inserted. The MEM-C 46 is a local memory used as a copy 
image buffer, a code buffer and the like. The ASIC 45 is an IC for image processing 
including hardware for image processing. The HDD 47 is a storage for storing image data, 
programs, font data and the like. 

5 

(First embodiment) 

Next, the execution environment 1 16 of the JAVA application 1 17 in the compound 
machine 100 is described as the first embodiment. 

Fig.3 shows a configuration example of the JAVA execution environment 116 
10 according to the first embodiment. As shown in Fig.3, the JAVA execution environment 116 
includes a compound machine class library 201, a virtual machine 202, a native program 
interface 203 and an application management part 204. 

The compound machine class library 201 is a class library used for the JAVA 
application 1 17 to easily operate the compound machine 100, so that the JAVA application 
15 117 can access APIs of the compound machine 1 00 by using the mechanism of the native 
program interface 203. By the compound machine class library 201 , machine-dependent 
functions can be identified, simple operation functions are provided, and various object 
oriented classes can be provided. 

The compound machine class library 201 according to this embodiment includes a 
20 basic JAVA class library, event classes for processing events, network transaction classes for 
performing processes for network communications, operation panel classes for drawing 
images on the operation panel of the compound machine 1 00, compound machine control 
classes for controlling the compound machine 100 and the like. The operation panel class 
and the compound machine control class are classes specific for the compound machine 100 
25 of this embodiment. The operation panel class and the compound machine control class may 
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be referred to as "compound machine class" hereinafter, and other classes (the basic JAVA 
class library, event classes, network transaction classes) may be referred to as "JAVA core 
class". 

A JAVA source code program is compiled into intermediate code (byte code). The 
5 virtual machine 202 has functions for interpreting and executing the byte code. The native 
program interface 203 has functions for the JAVA code executed by the virtual machine 202 
to be interoperable with applications and libraries written by a different programming 
language such as the C language. 

The application management part 204 has functions for managing the JAVA 
10 applications. For example, the application management part 204 has functions for displaying 
a list of JAVA applications, installing and updating the JAVA applications, deleting installed 
JAVA applications, setting a password for registering applications, storing JAVA 
applications and the like. In addition, the application management part 204 performs JAVA 
application execution management such as launch, forced termination, suspend, and resume 
1 5 for the JAVA application. 

The application management part 204 is implemented in the compound machine 100 
as a component independent from the virtual machine 202, so that the application 
management part 204 cannot be controlled from the JAVA application 117. As shown in 
Figs.4A and 4B, the application management part 204 can be implemented as a JAVA 
20 application (Fig.4A), or can be implemented as a C language program (Fig.4B) or the like. 
Since the JAVA execution environment 1 16 is an application mounted on the 
compound machine 100, the JAVA execution environment 116 can be installed into the 
compound machine 100 in the same way as other applications. For example, the JAVA 
execution environment 116 can be installed into the compound machine 100 from a memory 
25 card. 
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(Example of JAVA application) 

Next, an example of the JAVA application is described. In the following example, a 
JAVA application that uses the operation panel class is described. Fig. 5 shows an example of 
5 a hierarchy structure of the operation panel class used by the JAVA application. Fig.6 shows 
a program list of the JAVA application. In the following, the application program may be 
referred to as "simple printer". 

Next, the program shown in Fig.6 is described. This program causes the compound 
machine 100 to display a user interface screen on the operation panel of the compound 
10 machine 100, receive a specified print file name from the operation panel, and print the 
specified file. The outline of the operation of the program is as follows. 

Right after the compound machine 100 is launched, a screen shown in Fig.7 is 
displayed on the operation panel. As shown in Fig.7, a character string "Simple Printer" is 
displayed on the upper part of the screen, and a button of "Get input filename..." is displayed 
1 5 on the center part of the screen. When the user touches the button of "Get input filename...", 
a software keyboard shown in Fig. 8 as an example is shown on the operation panel. On the 
software keyboard, a title : "Input file name" is displayed, so that the user inputs a name of 
a file that the user wants to print. For example, when the user inputs 'Vusr/hdd/photo.tiff , the 
program causes the compound machine 100 to print the "photo. tiff ' file that is stored in a 
20 directory : "/usr/hdd". 

In the following, the program is described according to the numbers of annotations of 
the program. 

"(1)" is a command for using the compound machine class library. "(2)" indicates 
that GWApp is inherited, in which GWApp is a prototype (abstraction) of the application of 
25 the compound machine on initial setting and end processing. Accordingly, the user does not 
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need to write complicated initial setting code and end processing code, and processes for 
receiving a message and the like can be hidden from the user. 

By "(3)", an object for operating a printer is created, and an object for displaying a 
message : "Simple Printer" is created by "(4)", and a button object for "Get input filename,.." 
5 is created by "(5)". "(6)" indicates to add an object such that a software keyboard is 

displayed at the time when the user touches the button. "(7)" indicate to display the software 
keyboard and prompt the fine name. The file specified by the software keyboard is printed 
by "(8)". 

In the button operation ((5) "Get input filename..."), the result of the button operation 
1 0 is received by the program as a message, and the program performs a process corresponding 
to the button operation in response to receiving the message. The process is set in 
addChangeListener() of (6). 

(Example of procedure from download to launch) 

1 5 Installing and launching of the JAVA application is managed by the application 

management part 204. Thus, by using the functions of the application management part 204, 
processes from download to launch can be performed in the following way. The procedure is 
described taking a case for launching the simple printer as an example with reference to a 
flowchart shown in Fig. 9. 

20 The application management part 204 is launched when the compound machine 100 is 

launched like other applications. By pushing an application selection key corresponding to 
the application management part 204, a user interface screen for operating the application 
management part 204 is displayed on the operation panel of the compound machine 100 in 
step SI . When the user identifies, on the user interface screen, that the simple printer is 

25 installed as a JAVA application, the user selects the simple printer to execute it in step S2. 
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If the simple printer is not installed, an application load screen is displayed by 
specifying load of application from the user interface screen in step S3. 

On the application load screen, the user selects whether to download the simple 
printer from a Web site or to download it from a memory card inserted into the compound 
5 machine in step S4. 

In the case when the simple printer is downloaded from the memory card, the 
application management part 204 checks files in the memory card, and displays file names 
stored in the memory card on the operation panel in step S5. When the user selects the 
simple printer in step S6, the application management part 204 checks if the application can 
10 be executed on the compound machine 100 in step S7. According to the result of the check, 
if the application can be executed, the application is downloaded and installed into the hard 
disk. In addition, the application management part 204 obtains the application name (simple 
printer) and add it to an application list in step S9, in which the application list is a file 
managed by the application management part 204 for the user to recognize installed JAVA 
15 applications. 

In the case when the simple printer is downloaded from the Web server, Web is 
selected in the step S4, so that a screen for specifying a URL is displayed from which screen 
the user inputs a URL of a Web site having the simple printer program in step S 1 0. Then, the 
application management part 204 accesses the Web site in step SI 1, and checks if the simple 

20 printer can be executed on the compound machine in step SI 2, and downloads the simple 
printer in step SI 3. Then, the application management part 204 installs the simple printer 
into the hard disk, obtains the application name (simple printer) and adds the name to the 
application list in step S14. 

Alternatively, the application management part 204 may automatically searches for 

25 the memory card or the Web server to install the application into the hard disk. In the above- 
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mentioned example, although an example in which the JAVA application is installed into the 
hard disk is described, the JAVA application is not necessarily installed into the hard disk to 
execute the JAVA application. 

For checking if the JAVA application can be executed in the compound machine 100, 
5 the application management part 204 checks program size, version of the program, program 
latest update information, use memory work size, use storage size, use network address, the 
term of validity (usable number), application program name and the like. These items of 
information are associated with the JAVA application. As described later, the items of 
information may be obtained from a JNLP file corresponding to the JAVA application. 

10 After the above-mentioned processes ends, the downloaded simple printer can be 

used, so that the user launches the simple printer from the user interface screen in step SI 5. 
Accordingly, the virtual machine 202 is launched and the simple printer is executed. 

The launched simple printer operates the compound machine 100 by using the JAVA 
core class and the compound machine class so as to display the before-mentioned user 

1 5 interface screen for the simple printer. The user inputs a name of a file that the user wants to 
print, so that the file is printed. In this example, "/usr/hdd/photo.tiff' is input, and a 
"photo. tiff ' file that is stored in a "/usr/hdd" directory in the hard disk in the compound 
machine 100 is printed. 

After the printing ends, the application management part 204 terminates execution of 

20 the simple printer. 



(Second embodiment) 

The compound machine 100 can automatically update a JAVA application that is 
installed in the compound machine 100 by using JNLP (JAVA Networking Language 
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Protocol). In the following, automatic update of the JAVA application by using JNLP is 
described. Following processes are controlled by the application management part 204. 

Since "JNLP file" (to be also referred to as "application information file") is used in 
the following processes, a description is given first for the JNLP file. The JNLP file is in a 
5 one-to-one correspondence with a JAVA application, and includes information on definitions 
of the JAVA application. That is, a JNLP file is attached to each JAVA application. 

Fig. 1 0 shows an example of a syntax of the JNLP file. The JNLP file is a 
XML(eXtensible Markup Language) file. The format of the JNLP file is in conformity with 
JNLP standard. However, the JNLP used in this embodiment is extended. Following is the 
1 0 extension. 

In Fig. 10, the description 1 is an information element which includes a title element 
(description 1 A) indicating an application name, a vender element (description IB) indicating 
a vender name, a telephone element (description 1 C) indicating a telephone number of the 
vender, a fax element (description ID) indicating a fax number of the vender, and a product 

15 ID element (description IE) indicating a product ID of the application. 

The description 2 indicates a security element. The description 3 indicates a resource 
element which includes a jsdk element (description 3 A) indicating a version of a JAVA 
application, ajar element (description 3B) indicating a Jar file (execution file of the JAVA 
application) and the version, and a sub-jnlp element (description 3C) indicating a SUB-JNLP 

20 file. 

The description 4 is an update element which is an element for setting an execution 
method of update. If the element is "auto", update of the application is automatically 
performed. If the element is "manual", update of the application is performed manually. If 
the element is "mail", an update notification mail is delivered when update of the application 
25 can be performed. 
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The description 5 indicates an install element which indicates an execution method for 
install. If the element is "auto", an install destination of the application is automatically 
selected. If the element is "manual", the install destination of the application is manually 
selected. The description 6 indicates whether the type of the application is "GUI present" or 
5 "GUI absent". 

Information of the JNLP file corresponding to the JAVA application generally has a 
tree structure as shown in Fig.l 1 . A JNLP file referred to from an upper JNLP file 
corresponds to a module that is used in execution of a JAVA program corresponding to the 
upper JNLP file. 

10 As described in the update element of Fig. 10, an installed JAVA application is a 

target of update. In the following, automatic update for automatically updating the installed 
JAVA application is described. 

Fig. 12 is a flowchart for automatically updating a JAVA application (update target 
application) in an SD card (which is an example of a memory card) or in a HDD to a JAVA 

15 application (update application) from a SD card. 

When a SD card including the update application is set in a SD card slot, the 
application management part 204 obtains a JNLP file of the update application in the SD card 
in step SI 01. When the update element of the JNLP file is "auto" and when the compound 
machine 100 includes an update target application same as the update application 

20 corresponding to the JNLP file (steps SI 02, SI 03), the application management part 204 
compares versions of the update application and the update target application in step SI 04. 
When the version of the update application is newer than the version of the update target 
application (step SI 05), the application management part 204 updates the update target 
application to the update application in step SI 06 (replaces the update target application with 
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the update application). That is, the application management part 204 updates the Jar file and 
the JNLP file. 

Fig. 13 is a flowchart for automatically updating a JAVA application (update target 
application) in the SD card or in the HDD with a JAVA application (update application) from 
5 a Web server. 

The application management part 204 obtains a JNLP file of the update target 
application in step S201 . When the update element of the JNLP file is "auto" and when the 
Web server that is connected to the compound machine 100 includes an update application 
same as the update target application (step S202, S203), the application management part 204 

10 compares versions of the update target application and the update application in step S204. 
When the version of the update application is newer than the version of the update target 
application, the application management part 204 updates the update target application with 
the update application in step S206. 

The destination that the compound machine 100 accesses for accessing the update 

1 5 application can be obtained by referring to the JNLP file. When the JNLP file is the tree 
structure, the above-mentioned process is performed for JNLP files of each layer. 

The trigger for starting the update may be an elapsed time from power on of the 
compound machine 100, a predetermined time, power ON/OFF of the compound machine 
100, before running/while running/after running application, an elapsed time while idling, 

20 and the like. 

Also in the first embodiment, the JNLP file can be used. In such a case, before 
downloading the JAVA application, the compound machine 100 can check if the JAVA 
application is executable according to information in the JNLP file. In this case, the JNLP 
file includes information used for determining whether the JAVA application is executable in 
25 the compound machine 100. For example, the JNLP file includes information for 
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authentication, device configurations (color supported, for example) necessary for executing 
the JAVA application, use resource information and the like in addition to the program size 
and the like described in the first embodiment. The information in the JNLP file are 
compared with resource information and the like in the compound machine 100. As a result, 
5 if the compound machine 100 determines that the JAVA application is not executable, a 
warning is output, for example. In addition, the Jar file may include a digital signature for 
authentication, so that the application management part 204 may verify the signature. 

(Third embodiment) 

1 0 Next, a method is described in which the compound machine 1 00 is operated remotely 

by executing a JAVA application in a PC which may be used for developing the JAVA 
application. 

Fig. 14 shows a system configuration for executing the JAVA application according to 
this embodiment. As shown in the figure, the system includes a PC 300 and a compound 
15 machine 100 that are connected via a network 400. The PC 300 is a PC used for developing a 
JAVA application for the compound machine 100, for example. 

The PC 300 includes a simple printer 301 that is a JAVA application, a JAVA core 
class 304, a client compound machine class 303 for operating the compound machine class in 
the compound machine 100, a remote application management part 302 for managing 
20 applications by communicating with the application management part 204 of the compound 
machine 100, a virtual machine 305 and a OS 306. 

The compound machine 100 includes a server compound machine application 210 in 
addition to the JAVA execution environment 116. The server compound machine application 
210 is an application executed in the compound machine 100 for providing remote operation 
25 service from the PC 300. The native program interface is not shown in Fig. 14. 
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The client compound machine class 303 in the PC 300 communicates with the server 
compound machine application 210, so that the client compound machine class 303 operates 
objects in the compound machine 100. Accordingly, the compound machine 100 can be 
operated remotely from the PC 300, and distributed processing of applications can be 
5 realized. The technique for operating objects in the compound machine 100 from the remote 
PC 300 can be realized by using JAVA based distributed object processing technology, for 
example. 

The remote application management part 302 communicates with the application 
management part 204 of the compound machine 1 00 so that the JAVA application 

10 management function for the compound machine 100 can be extended to the PC 300. The 
remote application management part 302 includes functions same as those of the application 
management part 204 of the compound machine 100. That is, the remote application 
management part 302 includes functions for the JAVA application execution management 
(launch / forced termination / suspend / resume and the like), install and update of the JAVA 

1 5 application, delete of installed JAVA application, password setting for application 

registration, storing JAVA application, display list of installed JAVA applications and the 
like. The above-mentioned processes are performed by communicating with the application 
management part 204 of the compound machine 100 as necessary. 

The client compound machine class 303 in the PC 300 also includes a function for 

20 emulating a part of functions of the compound machine 100. For example, the client 

compound machine class 303 can emulate operations of the operation panel of the compound 
machine 100. 

For operating the compound machine 100 by using an application executed in the PC 
300, it can be selected whether to use the operation panel of the compound machine 100 or to 
25 use the emulation function in the PC 300. In the case where the operation of the operation 
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panel is emulated, the screen to be displayed on the operation panel of the compound 
machine 100 is displayed on the PC 300. The keyboard and the mouse of the PC 300 are 
used for operating the operation buttons displayed on the PC 300. The selection between 
using the operation panel of the compound machine 100 and using the keyboard and the 
5 mouse of the PC 300 is performed by sending a request from the remote application 

management part 302 to the application management part 204 of the compound machine 100. 
For example, when the remote application management part 302 notifies the application 
management part 204 in the compound machine 100 that the PC 300 emulates the operation 
panel, the application management part 204 controls the compound machine 100 such that 

10 screen display information generated by operating the compound machine 100 is sent to the 
PC 300 instead of displaying on the compound machine 100. 

When executing the JAVA application from the PC 300, as to same kind of resources 
in the remote PC 300 and the compound machine 100, the user can select one between the 
remote PC 300 and the compound machine 100. For example, as to "hard disk" that is 

1 5 included in both of the PC 300 and the compound machine 1 00, the user can select whether 
using a hard disk of the PC 300 or a hard disk of the compound machine 100 from the PC 
300. Other such resources are resources for networking, I/0(USB, ilink, RS 232C) and the 
like. 

Next, in the environment indicating Fig. 14, a procedure for operating the compound 
20 machine 100 by executing a JAVA application in the PC 300 is described with reference to a 
flowchart of Fig. 15. In the following example, the simple printer is used as an example. 

First, the remote application management part 302 is launched in the PC 300. In the 
compound machine 100, the JAVA execution environment 116 including the application 
management part 204, and the server compound machine application 210 are already 
25 executed. 
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The remote application management part 302 displays a screen for selecting an 
application on the PC 300 in step S21. At this time, it is checked whether the JAVA 
application is installed in the hard disk in the compound machine 100 or in the hard disk in 
the PC 300. In the check of the JAVA application, for example, the remote application 
5 management part 302 checks the JAVA application in the PC 300, and the application 
management part 204 in the compound machine 100 checks the JAVA application in the 
compound machine 100 and the application management part 204 notifies the remote 
application management part 302 of the check result. When the JAVA application exists, the 
JAVA application name is displayed on the screen. When the user selects the simple printer, 
1 0 the simple printer is launched in step S22. 

As a result of the check whether the JAVA application is installed, if the JAVA 
application is not installed in either of the hard disks, an application load screen is displayed 
by specifying application load from the screen in step S23. 

The user selects, from the application load screen, whether to download the simple 
1 5 printer from a Web site or from a memory card inserted in the compound machine 1 00 in step 
S24. 

When the user select to install the JAVA application from the memory card, the 
application management part 204 recognizes the memory card when the memory card is 
inserted into the compound machine 1 00, and the application management part 204 checks 
20 file information in the memory card, and notifies the remote application management part 
302 of the file information in step S25. 

The remote application management part 302 displays the notified file information on 
the screen of the PC 300 in step S26, so that the user selects the simple printer in step S27. 
Then, the remote application management part 302 notifies the application management pat 
25 204 that the simple printer is a target for downloading. The application management part 204 
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sends information on the application (simple printer) to the remote application management 
part 302. The remote application management part 302 checks whether the simple printer is 
executable in the environment of the system in step S28. If the remote application 
management part 302 determines that the simple printer is executable, the remote application 
5 management part 302 instructs the application management part 204 to download the simple 
printer, so that the simple printer is downloaded in step S29 and installed into an install 
destination (hard disk of the PC 300 or the hard disk of the compound machine 100) that is 
already specified in step S30. In addition, the simple printer is added to the application list. 
The check items in the step S28 are, for example, program size, version, program 

1 0 latest update information, use memory work size, use storage size, use network address, the 
term of validity (usable number), application program name and the like. 

In the case when the simple printer is installed from a Web sit, the remote application 
management part 302 displays a screen for allowing the user to specify a URL of the Web 
server, so that the user inputs the URL from the screen in step S3 1 . Then, the remote 

1 5 application management part 302 notifies the application management part 204 in the 

compound machine 100 of the URL in step S32. Then, the application management part 204 
accesses the Web site of the URL in step S3 3, and checks whether the application (simple 
printer) in the Web site can operate the compound machine 100 from the PC 300 in step S34. 
This check can be also performed by the remote application management part 302. In this 

20 case, the application management part 204 obtains predetermined information (JNLP file for 
example) and send the information to the remote application management part 302. 

When it is determined that the application can operate the compound machine 100, 
the simple printer is downloaded in step S35, and installed in a specified hard disk. Then, the 
simple printer is added to the application list in step S36. 
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When the simple printer is installed, the simple printer can be selected from a screen 
of step S21 . When the simple printer is selected, the remote application management part 
302 loads the simple printer in the virtual machine 305 in the PC 300, so that the simple 
printer is executed in step S37. 
5 The simple printer operates the compound machine 1 00 by using the JAVA core class 

304 and the client compound machine class 303. In the operation of the compound machine 
100, for example, the simple printer 301 sends a message to the server compound machine 
application 210 in the compound machine 100, so that the server compound machine 
application 210 operates objects in the JAVA execution environment in the compound 

1 0 machine 1 00 so as to operate the compound machine 1 00. 

As mentioned before, the simple printer 301 initially displays the graphical interface 
screen. Whether displaying the screen on the PC 300 or on the operation panel of the 
compound machine 100 can be selected. For example, after the user selects the simple 
printer, the remote application management part 302 displays a screen for selecting whether 

1 5 displaying the screen on the PC 300 or on the operation panel of the compound machine 1 00, 
so that the selection is realized. In this embodiment, the PC 300 is selected and a screen that 
is an emulation screen of the operation panel is displayed on the PC 300. 

Next, the user selects, from the screen of the PC 300, a name of a file to be printed. 
The user can selects one among the hard disk of the PC 300 and the hard disk of the 

20 compound machine 100 as a storage of the file that the user wants to print. Since the user can 
selects the hard disk of the compound machine 100, the user can perform operations on the 
PC 300 as if to operate the compound machine 100 on the operation panel. The selection can 
be performed by displaying a screen for selecting between the hard disks when the simple 
printer is selected by the remote application management part 302. 
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When the hard disk of the compound machine 100 is selected, the user specifies a file 
to print as "/hdd/ts/photo.tiff ' for example from the screen of the PC 300. As a result, the file 
in the hard disk of the compound machine 100 is selected so that the file is printed. 

For ending the operation of the compound machine 100, the remote application 
5 management part 302 requests the application management part 204 of the compound 

machine 100 to end or pause the application, and ends communications with the compound 
machine 100. 

Like the second embodiment, also in the third embodiment, the JAVA application can 
be automatically updated by using the JNLP file. 

10 

(Fourth embodiment) 

In the following, another example regarding the remote operation of the third 
embodiment is described as the fourth embodiment. In the fourth embodiment, the 
compound machine 100 is configured as shown in Fig. 16. In the compound machine 100 in 
1 5 Fig. 1 6, the JAVA execution environment 1 1 6 and the JAVA application 1 1 7 are changed to a 
JSDK application 147 and a JSDK platform 148. The JSDK platform 148 is for performing 
mediation with other software and application management and the like. 

"SDK" means a specific software development kit, and an application developed by 
using the SDK is called "SDK application". As a specific SDK, for example, "JSDK" is 
20 provided for developing an application by using JAVA language. An application developed 
by using the JSDK is called "JSDK application". 

Fig.17 shows classes of the JSDK application 147 and the JSDK platform 148 in 
Fig. 16. The JSDK application 147 and the JSDK platform 148 are compiled from source 
code to byte code by a JAVA compiler, and are executed by a JAVA virtual machine step by 
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step. The JSDK application 147 and the JSDK platform 148 are based on Personal Basis 
Profile of JAVA 2 Micro Edition. 

The JSDK application 147 includes a user application 501, a JSDK GUI Manager 
511, and a Task Bar Manager 512. 
5 The user application 501 is a JSDK application developed by using the JSDK by a 

user (a software vender, for example) of the compound machine 100. The JSDK GUI 
Manager 51 1 is a JSDK application for displaying operation screens for operating JSDK 
applications. The Task Bar Manager 512 is a JSDK application for displaying task bars for 
operating JSDK applications. 
10 The user application 501 is "Xlet" that is a JAVA application. Each of the JSDK GUI 

Manager 511 and the Task Bar Manager 512 is "Xlet (XletEx)" that is extended from the 
Xlet. 

The JSDK platform 148 includes classes such as a JSDK Main 521, a JSDK 
Environment 522, a Locale Manager 523, a Xlet Manager 531, a Multi Xlet Manager 532, a 

1 5 JSDK Manager 533, a Send Manager 541 , an Event Manager 542, a System Event Manager 
543, a Panel Manager 544, an Install Manager 545, a Server/Client Manager546 and the like. 

The JSDK Main 521 is a class for launching the JSDK Environment 522. The JSDK 
Environment 522 is a class for performing launch environment setting for the JSDK system. 
The Locale Manager 523 is a class for performing foreign language supporting and the like. 

20 The Xlet Manager 53 1 is a class for managing life cycle of the Xlet. The life cycle of 

the five Xlets are managed by five Xlet Managers. The five Xlets are in a one-to-one 
correspondence with the five Xlet Managers. All of the life cycle of the all Xlet managers are 
managed by the Multi Xlet Manager 532. The JSDK Manager 533 is a class for managing 
the life cycle of the whole of the JSDK system. For example, the life cycles of the Multi Xlet 

25 Manager 532, the Send Manager 541, the Event Manager 542, the System Event Manager 
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543, the Panel Manager 544, the Install Manager 545 and the Server/Client Manager 546 are 
managed by the JSDK Manager 533. The life cycle of the Xlet is state transitions, for 
example, initialization state (Loaded), paused state (Paused), active state (Active), end state 
(Destroyed) and the like. 

5 The System Event Manager 543 is a class for managing system events (such as power 

mode) from the platform 120. The Panel Manager 544 is a class for performing mediation 
and the like when one Xlet occupies the screen of the operation panel. The Install Manager 
545 is a class for managing install or uninstall of applications from the SD card and the Web 
server. 

10 The JSDK system of Fig. 17 includes JSDK API 551 and JSDK API 552. The 

difference between the Xlet and the XletEx is that the XletEx can use the JSDK API 551 for 
accessing objects and can access the JSDK platform. The compound machine 100 of Fig. 16 
further includes a JSDK Session 553 and a Native JSDK Session 554 that are interfaces 
between C language and JAVA language. The compound machine 100 of Fig. 16 further 
1 5 includes a CVM 555 that is a JAVA virtual machine. 

As shown in Fig. 18, the compound machine 100 is connected to a PC 701. The PC 
701 functions as an emulator of the compound machine 100. 

The PC 701 in Fig.18 includes, for example, a keyboard 712, a mouse 713, a display 
714 and the like. The body 711 includes a CPU, a ROM, a RAM, a NVRAM, a HDD, a 
20 MODEM, and a NIC and the like. 

The keyboard 712 and the mouse 713 are hardware (operation part) used by an 
operator for inputting data. The display 714 is hardware (display part) for outputting data. 

Fig. 19 shows classes of the JSDK application 147 and the JSDK platform 148 in the 
PC 701 in Fig.18. The PC 701 of Fig.19 includes the JSDK application 147 and the JSDK 
25 platform 148 same as those shown in Fig. 16. 
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The differences between Fig. 17 and Fig. 19 are as follows. 

First, the Panel Manager 544 in Fig. 1 7 is replaced by a Panel Manager Emulator 744 
in Fig. 19. Second, the JSDK Session 553 in Fig. 17 is replaced by the Emulator JSDK 
Session 753 in Fig. 19. Third, the Native JSDK Session 554 of Fig. 17 is replaced by an Event 
5 Emulator 754 in Fig. 19. Fourth, the CVM 555 of Fig. 17 is replaced by the JVM 755 of 
Fig. 19. 

The Panel Manager Emulator 744 is a class for emulating the Panel Manager 544 to 
change operations of the operation panel to operations of the keyboard 712 and the mouse 
713. The Emulator JSDK Session 753 is a class for establishing communication routes. The 
10 Event Emulator 754 is a class for emulating operations of the compound machine 100. The 
JVM 755 is a JAVA virtual machine for executing the JSDK application 147 and the JSDK 
platform 148. 

Fig.20 is a figure for explaining execution procedure of preparation processes for 
remote operation in the compound machine 100. 
15 First, a communication session is established between the Server/Client Manager 546 

in the compound machine 100 and the Server/Client Manager 546 in the PC 701 (1). The 
establishment of the session is performed by a protocol similar to SIP (Session Initiation 
Protocol). 

Next, the Server/Client Manager 546 in the compound machine 100 asks the JSDK 
20 Manager 533 in the compound machine 100 whether the compound machine 100 can change 
to the remote operation mode, so as to determine whether the remote operation can be 
performed (2). 

When the remote operation can be performed, the Server/Client Manager 546 in the 
compound machine 1 00 sends a request message necessary for remote operation to the PC 
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701 via the Send Manager 541 (3), and receives a response message necessary for remote 
operation from the PC 701 via the Event Manager 542 in the compound machine 100 (4). 

Next, the Server/Client Manager 546 in the compound machine 100 requests the 
Panel Manager 544 to send information for remote operation to the PC 701 (5). 

Finally, between the Server/Client Manager 546 in the compound machine 100 and 
the Server/Client Manager 546 in the PC 701, notifications are exchanged for notifying each 
other of completion of preparation of remote operation (6). Accordingly, the remote 
operation from the PC 701 to the compound machine 100 can be performed. Functions for 
realizing distribution processes of applications described in the third embodiment can be 
included, for example, in the Server/Client Manager 546 in the compound machine 100 and 
the Server/Client Manager 546 in the PC 701. 

Each program described in the first to fourth embodiments can be stored in a 
recording medium such as a memory card. From the recording medium, the program can be 
installed in the compound machine 100. In addition, a program for constituting the JAVA 
execution environment such as the virtual machine can be also stored in a recording medium 
such as a CD-ROM, and can be installed in the PC 300 from the CD-ROM. 

As mentioned above, according to the present invention, by providing a JAVA 
execution environment in the compound machine 100, the JAVA application can be easily 
installed and launched on the compound machine 100. Therefore, the JAVA application can 
be easily executed. In addition, the compound machine 100 can be operated by executing a 
JAVA application in a terminal apparatus connected to the compound machine 100 via a 
network. 

The present invention is not limited to the specifically disclosed embodiments, and 
variations and modifications may be made without departing from the scope of the present 
invention. 
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The present application contains subject matter related to Japanese patent application 
No.2003-082908, filed in the JPO on March 25, 2003, and Japanese patent application 
No.2004-078979, filed in the JPO on March 18, 2004, the entire contents of which being 
incorporated herein by reference. 
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